SemanticScuttle - klotz.me

klotz: spark* + bloom filter* + orc*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Generic Load/Save Functions - Spark 3.2.0 Documentation

   usersDF.write.format("orc")
   .option("orc.bloom.filter.columns", "favorite_color")
   .option("orc.dictionary.key.threshold", "1.0")
   .option("orc.column.encoding.direct", "name")
   .save("users_with_options.orc")
   Find full example code at "examples/src/main/scala/org/apache/spark/examples/sql/SQLDataSourceExample.scala" in the Spark repo

   2021-12-01 Tags: spark, orc, bloom filter, parquet, hadoop by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0